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Abstract. We show that isometries between open sets of Carnot groups are affine. This 
result generahzes a result of Hamenstadt. Our proof does not rely on her proof. In addition, 
we study global isometries of general homogeneous manifolds equipped with left-invariant 
subFinsler distances. We show that each isometry is determined by the blow up at one 
point. For proving the results, we consider the action of isometries on the space of Killing 
vector fields. We make use of results by Capogna-Cowling and by Gleason-Montgomery- 
Zippin for obtaining smoothness of the isometric action. 
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1. Introduction 

A fundamental problem in geometric analysis is the study of spaces that are isometrically 
homogeneous, i.e., metric spaces on which the group of isometries acts transitively. Such 
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spaces have particular differentiable structures under the additional assumptions of being 
of finite dimension, locally compact, and the distance being intrinsic. Indeed, one can 
characterize such spaces as particular subFinsler manifolds, by using the theory of locally 
compact groups and methods from Lipschitz analysis on metric spaces, |Gle52[[BM46([MZ74t 
IBer89al[Ber89b] . Despite the fact that the group of global isometrics of such manifolds is 
a Lie group and acts smoothly and by smooth maps, the local isometrics are still not 
completely understood. Here, with the term 'local isometry' we mean isometry between 
open subsets. 

In this paper we give a complete description of the space of local isometrics for those 
homogeneous spaces that also admit dilations. These spaces, called Carnot groups, are 
particular nilpotent groups equipped with general left-invariant geodesic distances. 

Our method of proof also shows that, as in Riemannian geometry, global isometrics of 
homogeneous spaces are uniquely determined by their 'first-order' expansion at a point. 
Such a characterization for isometries was known already in some specific cases, e.g., for 
Riemannian manifolds, Banach spaces, and subRiemannian Carnot groups. 

The study of isometries of distinguished Riemannian manifolds, such as homogeneous 
spaces, symmetric spaces, and Lie groups, has been a flourishing subject. References for the 
regularity of isometries are the classical papers [MS39, Pal57b] . see also [CH701 Tay06| . For 
the general theory of transformations groups, we refer to |Pal57al IKob95[ [CE80] . Regarding 
the Finsler category, we mention the work |DII02j . Banach spaces are classical and the space 
of isometries is well studied, see |FJ931lBL00j . There has been some effort in understanding 
isometries of subRiemannian manifolds, see [Str861 [S^tr891 IIIam901 IKisOSj IHlal2] . Regarding 
Carnot groups, in the deep paper |IIam90j . U. Hamenstadt showed that isometries are affine, 
in the case that the isometry is globally defined and that the distance is subRiemannian (and 
not just subFinsler). We say that an isometry of a group (equipped with a left-invariant 
distance) is afhne if it is the composition of a left translation with a group isomorphism. 

We generalize Hamenstadt 's result to the setting of a subFinsler distance and isometries 
defined only on some open set. We need to point out that, first, to obtain such a local result, 
one cannot use the same argument as in jHam90j to deduce smoothness of the map. Actually, 
the issue of smoothness was a subtle point, which was clarified only later by I. Kishimoto in 
|Kis03| . for global isometries. Moreover, in Hamenstadt 's strategy, one needs to consider a 
blow down of the isometry, which requires the map to be globally defined. Hence, we shall 
provide a new method of proof. 



1.1. Statements of main results. Let G be a Lie group and H he a closed subgroup. Let 
M = G/H be the homogeneous manifold of left cosets. Hence, the group G acts transitively 
on M on the left. Let A be a G-invariant subbundle of the tangent bundle TM. We assume 
that A is bracket-generating and call it horizontal bundle. Fix a norm on Ap, for p G M, 
and assume that it is G-invariant. Then the Carnot-Caratheodory distance between two 
points of the manifold is the infimum of the lengths of curves tangent to A and connecting 
the two points. Since the length is measured using the norm, such a distance is also called 
subFinsler. If G = M and, setting Vi := Ag and V^+i := [Vi, Vj], we have the property that 



Lie(G) = © • • • e 14, 
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then the space is called subFinsler Carnot group. See Section [2] for more detailed definitions, 
notation, and properties of such spaces. 

Our first theorem characterizes local isometries of a subFinsler Carnot group as affine 
maps. 

Theorem 1.1. Let {G,d) be a subFinsler Carnot group. Let il.i,Q2 C G be two open 
sets. Let / : f^i ^ Q2 be an isometry. Then there exists a left translation r and a group 
isomorphism (j) of G such that f is the restriction to ili of t o (p. 

Note that in the statement above we require the domain f^i to be open. In Section [331 
we shall see that such an assumption is necessary, unlike in the Euclidean case. However, 
connectivity is not required. 

With a similar method as for the proof of the first theorem, we show that global isometries 
of a subFinsler homogeneous space are characterized by their value at one point and the 
differential at this point. In [Str861 [Str89] . the same conclusions were obtained for smooth 
isometries of particular subRiemannian manifolds. 

Theorem 1.2. Let M = {G/H,d) be a connected homogeneous manifold equipped with 
a G -invariant subFinsler distance with horizontal subbundle A. Let f : M ^ M be an 
isometry. Then f is an analytic map. Moreover, if h : M ^ M is another isometry with 
the properties that f{p) = h{p) and (d/)p|Ap = {dh)p\Aj,, for some p G M, then f = h. 

Even under the additional assumption that the manifold in Theorem 11.21 is actually a 
Lie group, one cannot have the same conclusions as in Theorem 11.11 Indeed, for general 
Lie groups, it is not true that isometries are necessarily affine maps. See the discussion on 
the inversion map on S'^ in Section 13.41 We should also point out that, in general, local 
isometries of homogeneous spaces do not extend to global isometries, e.g., in the case of the 
flat cylinder (see Section [3^ . 

By |MM95j . every quasiconformal mapping between two Carnot-Caratheodory spaces 
admits a blow-up map at almost every point, that is an isomorphism between two Carnot 
groups. If the two Carnot-Caratheodory spaces are Carnot groups, such a result was proven 
in |Pan89j . For this reason, the blow-up map is also called Pansu differential. Whenever / 
is an isometry of M, as in Theorem 11.21 then / is smooth and df{p)\/\p coincides with the 
differential of the blow up at p, restricted to Ap. In other words. Theorem 11.21 states that 
every isometry / of M is determined by f{p) and by its blow-up at p. 

We complete the introduction with a problem. 

Question 1.3. Given a connected and simply connected Lie group {G,d) equipped with 
a left-invariant subFinsler distance, let G be the tangent cone of G at e. For which group 
automorphism (p oi G there exists an isometry of G that has (j) as blow up at the identity? 

There are obvious necessary conditions. Namely, the differential of (p should preserves the 
strata and be an isometry when restricted to the first stratum. However, these conditions 
are not sufficient, see the discussion on the Riemannian Heisenberg group in Section [3.41 
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1.2. Structure of the paper. The proof of our results is divided into several steps. The 
overall strategy of the two theorems is similar. However, in few instances we need different 
approaches. Regarding global isometries of subFinsler homogeneous manifolds, we show 
their smoothness in Section [2.21 relying on the classical solutions of the Hilbert 5*^* problem. 
This method works only for mappings that are globally defined. For the local isometries of 
Theorem 11.11 we shall rely on a regularity result of 1-quasiconformal mappings in |CC06] , 
that we reformulate in Theorem 12.81 

Once we know that isometries are smooth, in Section 12.31 we consider the action of their 
differentials on vector fields that generate flows of isometries (Killing vector fields) . For local 
isometries, we need an extension result for Killing vector fields that is proven in Section [2.41 
and that relies on a method developed in |Tan70j . In Section [3. II we prove Theorem 11.21 In 
Section 13.21 we provide a weak version of Theorem 11.11 Namely, in Theorem 13. 3| we assume 
that r^i is connected and that the distance is subRiemannian. In Section 13.31 we complete 
the proof of Theorem II. 1[ We then devote Section [3.41 to a number of final remarks. 

Acknowledgements. Both authors would like to thank Universite Paris Sud, Orsay, where 
part of this research was conducted. This paper has benefited from discussions with E. 
Breuillard and P. Pansu. Special thanks go to them. 

2. Preliminaries 

2.1. General notation. Let G be a Lie group. Denote by g or by Lie(G') the Lie algebra 
of G whose elements are tangent vectors at the identity e of G. For y G 3, we denote by Y 
the left-invariant vector field that coincides with Y in e. So [X, y] := [X,y]e. 

Let H he a closed subgroup of G. Hence, the space G/H of left cosets gH, with g G G, 
has a natural structure of analytic manifold, see [HelOll page 123]. The group G is a Lie 
transformation group of M = G/H. Namely, every element g G acts by left translations 
on M, i.e., induces the diffeomorphism 

(2.1) g'H^g-{g'H):=gg'H. 

For yea, we denote by y^ the vector field of M whose fiow ^*y^ at time t is 

(2.2) [P] = exp(ty) • p, Vp G M. 

It is well known (see [HelOll Theorem 3.4]) that, for X, y G g, we have 

(2.3) [x,y]t = -[xt,yt]. 

We shall fix a G-invariant subbundle A of the tangent bundle TM of M. The choice of 
such a subbundle can be seen in the following way. In the homogeneous manifold M we 
denote by o the coset H and call it the origin of M. Notice that the action of on M 
fixes the origin. There is a one-to-one correspondence between iif-invariant subspaces Aq 
in To{M) and Ad//-invariant subspaces V in Lie(G) that contains Lie(ff). We choose such 
a subspace Aq in ToiG/H), and therefore, such a y C g. Then, for all gH G G/H, the 
subbundle A is defined as 

^gH ■= g*^o, 
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where g^, is the differential of the map in ()2.ip . The subbundle is well defined, i.e., the 
definition does not depend on the representative in gH, exactly because Aq is i?-invariant. 

If the subspace V C Q associated to Aq has the property that g is the smallest Lie 
subalgebra of q containing V, then V (or, equivalently. A) is said to be bracket- generating. 

We shall fix a G-invariant norm on A. The choice of such a norm can be seen in the 
following way. Fix a seminorm on V that is Ad//-invariant and for which the kernel is 
Lie(i?). The projection from G to M gives an i7-invariant norm ||'|| on Ao. Hence, we have 
an induced G-invariant norm on A by 



Since the initial norm is Adj:/-invariant, it follows that the above equation is independent 
on the choice of representative in gH. 

An absolutely continuous curve 7 : [0, 1] ^ M is said to be horizontal (with respect to 
A) if the derivative 'y{t) belongs to A, for almost every t G [0, 1]. Each horizontal curve 7 
has an associated length defined as 



Definition 2.4 (SubFinsler homogeneous manifolds). Let M = G/H be a homogeneous 
space formed by a Lie group G modulo a closed subgroup H. We are given a bracket- 
generating G-invariant subbundle A C TM and a G-invariant norm ||-|| on A. Equivalently, 
we are given an Ad//-invariant and bracket-generating subspace V C Lie(G), with V ^ 
Lie(i?), and an Ad/^-invariant seminorm ||-|| on V whose kernel is Lie(if). The subFinsler 
distance (also known as Finsler Carnot-Caratheodory distance) between two points p,q & M 
is defined as 

(2.5) d(j),q) := inf{L(7) | 7 horizontal and 7(0) =p, 7(1) = q}. 

We call the pair (M, d) a subFinsler homogeneous manifold. 

By Chow's Theorem |Mon02t Chapter 2], the topology of (M, d) is the topology of M as 
manifold. Notice that, by construction, the above subFinsler distance is left-invariant, i.e., 
every left translation ()2.ip is an isometry of (M, d) . 

By the work of V. N. Berestovskii, we know that the above-defined subFinsler homoge- 
neous manifolds are the only geodesic spaces that are isometrically homogeneous, are locally 
compact, have finite topological dimension, and whose distance is a geodesic distance. Such 
a result is based on Montgomery-Zippin's characterization of Lie groups, see Theorem 12.91 

Theorem 2.6 (Consequence of |MZ74j . |Ber89bj . and |Mit85j ). Let X be a locally com- 
pact and finite- dimensional topological space. Assume that X is equipped with an intrinsic 
distance d such that its isometry group lso{X,d) acts transitively on X. Then {X,d) is 
isometric to a subFinsler homogeneous manifold. 

If, moreover, the space {X,d) admits a non-trivial dilation, i.e., there exists A > 1 such 
that {X,\d) is isometric to {X,d), then {X,d) is a subFinsler Carnot groups (see definition 
below). 



{9 )*v 
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By the above result, subFinsler Carnot groups are special cases of subFinsler homogeneous 
manifold. We refer to [Mon02t page 38] for the easy proof that such spaces admit dilations, 
for all A > 1. 

Definition 2.7 (SubFinsler Carnot groups). Given a subspace Vi of the Lie algebra of a 
Lie group G, define by recurrence the subspaces Vj as 

V,:=[VuVj-i], Vj>l. 

If one has that 

g = Vi e • • • e Vfc © • • • , 

then G is said to be a (nilpotent) stratified group and Vi is called the first stratum (of the 
stratification {V^})- If d is the Carnot-Caratheodory distance associated to G, Vi, and some 
norm ||'|| on Vi, then the pair {G,d) is called subFinsler Carnot group, or simply Carnot 
group. 

If the norm in Definition 12.41 comes from a scalar product, then the associated distance is 
called Carnot-Caratheodory or suhRiemannian. If this is the case for a subFinsler Carnot 
group, then we call it suhRiemannian Carnot group. We shall use the notation G, rather 
than G, to emphasize that we are dealing with a Carnot group, rather than a general Lie 
group. 

One can show that a curve in a subFinsler manifold has finite length if and only if it is 
a horizontal curve, up to reparametrization. Consequently in the case that an isometry / 
of a subFinsler homogeneous manifold is C^, then it is a contact map, i.e., its differential 
preserves the subbundle. Namely, 

Here and hereafter, we use both notations df or to denote the differential of a differentiable 
map /, viewed as push-forward operator on vectors or on vector fields. 

We shall need to show that isometrics between open sets of a subRiemannian Carnot 
group are analytic maps. Such a regularity result follows from the work of Capogna and 
Cowling on 1-quasiconformal mappings. We state here a weaker form of their result ( |CC061 
Theorem 1.1]). 

Theorem 2.8 (Consequence of jCCOGj ). Let C G be an open set of a subRiemannian 
Carnot group G. Let f : Q ^ G be a biLipschitz embedding. 

(i) // / is an isometry, then f is analytic. 

(ii) If for a.e. p G 0, the blow-up of f at p is an isometry ofG, then f is analytic. 

2.2. Smootliness of the isometric action. By definition, an isometry is a map that 
preserves the distance. Hence, there is no a priori smoothness assumption. In this section, 
we shall explain why, in the case of subFinsler homogeneous manifolds, one has in fact 
that (global) isometries are smooth maps forming a Lie group and the action is smooth. 
Smoothness of the local action of isometries between open sets of Carnot groups will follow 
from a different reasoning, see Corollarv 12.181 

The smoothness of global maps is a consequence of the work of Gleason |Gle52| and 
Montgomery and Zippin |MZ52[ IMZ74] . In particular, one has the following general result. 
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Theorem 2.9 (Gleason-Montgomery-Zippin). // a second countable and locally compact 
group H acts by isometrics, continuously, effectively, and transitively on a locally compact, 
locally connected, and finite- dimensional metric space X then H is a Lie group and X is a 
differentiable manifold. 

To obtain the regularity of the action in the group parameters we use the fohowing 
theorem, which is a generalization of Bochner-Montgomery's resuh |BM45| . 

Theorem 2.10 f |MZ741 page 213]). Let H x M ^ M, {h,x) ^ h{x), be a (continuous) 
action of a Lie group H on an analytic manifold M . Assume that, for all h £ H, the map 
X I— > h{x) is analytic. Then h[x) is analytic in h and x simultaneously. 

For studying local isometrics, we will make use of another result of Montgomery, see 
|Mon45a[ [Mon45bj . We obt ain a Lie group structure for compact groups acting by analytic 
maps. The result holds more generally, see |MZ74l page 208, Theorem 2], but we only need 
the following weaker result. 

Theorem 2.11 ( |Mon45al Theorem 3]). If H is a compact effective group acting on a 
connected analytic manifold M and if each transformation of H is analytic then H does not 
contain arbitrarily small subgroups other than the identity; or, in other words, H considered 
in itself is a Lie group. 

From Theorem 12. 9^ we deduce the following consequence, which was partially observed 
in |Kis03j as well. 

Corollary 2.12 (Consequence of Hilbert S*'' theory). Let G be a Lie group acting on an 
analytic manifold M . Assume that the action is transitive and analytic. Let d be a G- 
invariant distance on M , inducing the manifold topology. Then the isometry group Iso(M) 
is a Lie group, the action 



is a compact Lie group. 

Proof. By Ascoli-Arzela Theorem we have that Iso(M) is locally compact and IsOo(M) is 
compact (both equipped with the compact open topology). Obviously they both are groups 
with the composition as multiplication. Furthermore, since G acts transitively on M, so 
does Iso(M). Therefore, by Theorem 12.91 it follows that Iso(M) is a Lie group. Being a 
compact subgroup, IsOo(M) is a Lie group as well. 

For the proof that the action of Iso(M) on M is analytic, let us explicit the analytic 
structures considered. The group G and the manifold M are given with their analytic 
structures, which we denote dg and ujm, respectively. Hence, by assumption, the action 



(2.13) 



Iso(M) X M ^ M 
{f,p) ^ f{p) 



is analytic, and the space 



IsOo(M) = {/ G Iso(G) I f{o) = o} 



(2.14) 
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given by (12. ip . is analytic. The group Iso(M) has an analytic structure (jJj of Lie group and, 
since it is acting transitively (and continuously) on M, there exists an analytic structure 
Com on M such that the map 

(2.15) (/,a;/) X (M,WAf) ^ (M,wm), 

given by (j2.13p . is analytic, see [HelOU page 123]. Every element of G induces an isometry. 
Hence, we have a map 

(2.16) t: (Cwg) ^ (1,0;/), 

induced by (|2.ip . The map t is a continuous homomorphism. By [HelOU Theorem 2.6] we 
have that l is in fact analytic. By composition of ()2.15p and ()2.16p . we have that 

(2.17) {G,ujG)y-{M,CjM)^{M,CjM), 

again given by ()2.ip . is analytic. By [HelOlt Theorem 4.2] there is a unique analytic structure 
on M for which the action given by p.lh is analytic. Therefore, we conclude that ujm = ojm- 
Hence, the map ()2.13p is analytic when M is given the initial analytic structure ujm- D 
Prom Theorem 12 . 1 1 1 we deduce the following consequence, which will be important in the 
study of local isometries of Carnot groups. 

Corollary 2.18 (Consequence of Hilbert 5*^ theory). Let B he a closed hall in a Carnot 
group centered at the identity e. Let X := {f : B ^ B isometry | /(e) = e}. Then 

(i) X is compact; 

(ii) X is a Lie group; 

(iii) for all X ^ B the map 

X ^ B 
f ^ fix) 

is analytic. 

Proof. Regarding part (i), since X is a family of equicontinuous and equibounded maps, by 
Ascoli-Arzela Theorem, the family is precompact. Since X is obviously closed, then it is 
compact. 

Part (ii) will follow from Theorem 12.111 Indeed, the set X is closed under composition. 
Hence it is a compact group acting on B. By Theorem 12. 8^ each element of X is an analytic 
map. Then Theorem 12.111 implies that X is a Lie group. 

Part (iii) follows immediately from Theorem 12.101 □ 

2.3. The action of an isometry on Killing vector fields. Let now M = {G/H,d) 
be a subPinsler homogeneous space with horizontal bundle A. In this section we define a 
filtration of the space of (global) vector fields that are infinitesimal generators of isometries 
of M. The properties of this space that are shown here are crucial to prove both our results. 

Definition 2.19 (Killing vector fields /C). A vector field Z on M is said to be a Killing 
vector field if there exists tQ > such that, for all t G [0,to]) the fiow <I>^ at time t is an 
isometry. We denote by fC the collection of all Killing vector fields. 
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One can show that /C is closed under sum and Lie bracket. Notice that Y £ V, then 
the vector field is a Killing vector field. Indeed, the flows of these vector fields are one 
parameter groups of the left action of G (see (12.2|1 ). The space /C is the Lie algebra of the 
group of (global) isometrics of M. Such a group, by Corollary 12.121 is a Lie group. Hence, 
/C is a finite dimensional Lie algebra. We recall that isometrics that are smooth are in 
particular contact maps. Therefore, given a Killing vector field Z with fiow <I>^, the fact 
that is contact implies that 

(2.20) [z,r(A)] cr(A), 

where r(A) denotes the space of smooth sections of the subbundle A. Indeed, if W G r(A), 
we have 

[w,z] = -Cziw) = ^^(<^%uw)\t=o G r(A), 

where Cz{W) denotes the Lie derivative along Z oi W. 

As in Section [2711 we denote by othe origin in M. We write /C_i := {Z £ IC \ Zq £ Aq}. 
Moreover, we denote ICq '■= {Z £ IC \ Zq = 0} and inductively, for every j > 1, we define 

}Cj := {Z £}Co\ [Z,Y^ £ /Cj_iVy £ V}. 

Notice that /Cj+i C /Cj for every i > —1. Moreover, each ICj is a vector space. 

If Z is a Killing vector field, we choose Y £ q such that (^^)o = Zq and therefore we 
decompose Z as 

(2.21) Z = Y'i + Z', 

with Z' £ ICq. We obtain the decomposition /C = + /Co, which is not necessarily a direct 
sum. We show the following property. 

Lemma 2.22. [/Co,/Cj] C /C^-, Vj > 0. 

Proof. We prove the lemma using induction. If j = 0, the statement is true, because the 
bracket of two vector fields that vanish at vanishes at as well. 

Suppose now that the claim is verified for all indexes from to j — 1 and pick Z £ KLq and 
Z' £ JCj. Clearly [Z, Z']o = 0, i.e., [Z, Z'\ £ ICq. It remains to prove that [[Z, Z'],Y^ £ /Cj_i, 
for every Y £V. First notice that the Jacobi identity yields 

(2.23) [[Z,Z'],Y^] = -[[Z,Y%Z'] + [[Z',Y\Z\. 

Recall the identification between V and Aq given in Section[2]and let Y' £ r(A) be such that 
= Y. Then [Z,Y^ = [Z,Y'] + [Z,Y^ -Y']. Therefore, it follows that [Z.Y^o = [Z,Y']o. 
We recall that Z satisfies (|2.20p . so that in particular [Z, y^]o £ Aq. Thus (|2.2ip gives 
[Z,yt] = w^ + W\ for some W £V wid.W' £ Kq. Since Kj C /Cj_i, by induction we 
conclude that 

(2.24) [[Z, Y\Z'\ = [W\ Z'] + [W, Z'\ £ /C,_i. 

Again by the induction hypothesis we have that [[Z',y^],Z] £ lCj~i, which, together with 
([2:24]) and ([223]), finishes the proof. □ 
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Lemma 2.25. Let f be an isometry between open and connected subsets of M . We assume 
that f is smooth and that f*Z uniquely extends to a Killing vector field for every Z € /C, 
for which we shall abuse the notation f^Z. Moreover, we suppose that dfo\ Ao is the identity, 
and that f(o) = a. Then 

(i) if Z ^ /C-i, then f^Z € Z + ICq; 

(ii) if Z ^ JCj with j > —1, then f^Z € Z + /Cj+i. 

Proof. The idea of the proof is the following. The first part is a consequence of the fact 
that dfo is the identity on Aq. The second part will follow by induction and Lemma 12.221 

Regarding the proof of (i), we first note that by hypothesis /* induces an isomorphism 
on /C. Thus for Z £ K. with Zq € Aq, by ()2.2ip there exist Y £ g and Z' € /Co such that 
f^Z = + Z'. Since /(o) = o, we have that 

= = dfoZo = Zo. 

So 

/,z = z + (yt _ + z' e z + /Cq. 

Hence (i) is proven. 

Regarding the proof of (ii), we proceed by induction on j. The case j = — 1 is given 
by (i). Now suppose that (ii) holds for every index from —1 to j — 1 and choose Z G YZj. 
Clearly (/*Z - Z)o = 0. We are left to prove that [/*Z - Z, yt] G K.j, for every Y £V. 
Using (i) and the induction hypothesis, we have 

(2.26) [/.z - z, yt] = [/,z, yt] - [z, yt] 

G[/.z,/,yt + /Co]-[z,yt] 

= /4z, yt] + [/,z, /Co] - [z, yt] c /c,- + [/.z, /Co] 

Notice that if /*Z G /Cj, then Lemma 12.221 together with (j2.26p imply (ii). In order to 
prove that /*Z G /Cj, we show that if /*Z G /C; for some / < j, then /*Z G /Cj+i. First, if 
/*Z G /C;, then [/^,Z, /Cq] ^ K,i- Then (|2.26p implies 

[/,z-z,yt] G/c, +/Czc/Cz. 

Therefore f^Z — Z £ /C;_|_i, whence 

/*Z G Z + /C;+i C /Cj + /C;+i C /Cj+i, 
because j > I- This concludes the proof. □ 

2.4. Unique extension for Killing vector fields. In this section we shall prove that 
an isometry defined among some open subsets of a subRiemannian Carnot group induces 
an isomorphism of the space /C of Killing vector fields. This fact will be important in 
order to apply the results of the previous section to the proof of Theorem II. 1[ A key tool 
throughout this section is Tanaka's prolongation theory. On the one hand, we shall use a 
finiteness criterium |Tan701 Corollary 2, page 76] to show finite dimensionality of Tanaka's 
prolongation, which will be in turn isomorphic to /C. On the other hand, the discussion in 
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[TaiiTOl Section 6] will imply that a locally defined Killing vector field is uniquely extended 
to an element of /C. 

We only recall what of Tanaka's theory is essential for our purposes. For an insight, we 
refer the reader to |Tan701 IYam93j . A recent survey can also be found in |0W11| . 
A linear self map u : 3 ^ g of a Lie algebra g is a derivation if 

u[X, Y] = [u{X), Y] + [X, u{Y)l yx, y € g. 
Given a nilpotent Lie algebra g with stratification Vi d) ■ ■ ■ (B Vs, we set 

Dero(g) := {u : g — > g derivation | uiVj) C Vj,\/j = 1, . . . , s}. 

Once we fix a scalar product on Vi, we denote by OiVi) the Lie group of linear isometries 
of Vi, and by oiVi) its Lie algebra. In particular, o{Vi) C g[(Vi). 

We recall now the definition of the Tanaka prolongation of the Lie algebra g with respect 
to the subspace 

go := {u G Dero(g) | njy, € o(Vi)}. 
Set Qj := V-j, for j G {— s, • • • , —1}- By induction, if /c > 1, define 

-1 

Qk := {nG g,-+fc g* | n[X, = [^x(X), Y] + [X, n(y)], VX, y G g}, 

j=-s 

where, if X G g and u G Qk with A; > 0, we set 

(2.27) [u,X]:=u(X). 

The Tanaka prolongation of the Lie algebra g with respect to go is the sum 

Prol(g) := g,-. 

The Lie algebra structure of g is extended to Prol(g) by (|2.27p and by the inductively 
defined formula 

(2.28) [u,v]{X) ■.= [u{X),v] + [u,v{X)], £ q^v e Sj, X e g. 

Lemma 2.29. Prol(g) is a graded finite dimensional Lie algebra. Namely [gj,gj] ^ gj+j, 
Vi, j > -s. 

Proof. The grading property and the Jacobi identity easily follow from the definition of the 
Lie bracket. By |Tan70t Corollary 2, pag 76], for showing finite dimensionality it is enough 
to prove that the space 

t)o := {uGgo |n[X,y] = 0,VX,y Gg} 

has finite prolongation in the sense of Singer and Sternberg, see |SS65j or |Kob95j . The set 
[)o can be identified with a subalgebra of o{Vi). By an easy argument the first prolongation 
of o{Vi) is trivial, see |Kob951 page 8]. □ 
We observe that the definition of prolongation that we provided above adapts to every 
choice of a subalgebra of Dero(g). Tanaka constructed these prolongation algebras to de- 
scribe the infinitesimal generators of mappings preserving some nonintegrable geometric 
structures. If, e.g., we prolong with respect to all of Dero(g), then we would obtain a char- 
acterization of those vector fields generating flows of contact mappings. More precisely, one 
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has that the prolongation algebra and the corresponding space of vector fields identify as 
Lie algebras whenever the prolongation if finite. 

In our case, since Prol(g) is finite by Lemma l2.29l Tanaka's method leads to the identifi- 
cation of Lie algebras 

(2.30) Prol(g) ^ /C. 

Now we observe that this same identification also applies to vector fields that are defined 
only locally. 

Definition 2.31. (Local Killing vector fields /Cq) Let {G,d) be a Carnot group. Let Z be 
a vector field on C G. We say that Z is a Killing vector field on 0, if there exist to > 
and C open set such that, for all t G [0,to]i the fiow '^yng at time t is an isometric 
embedding of r^o inside G, with respect to the Carnot-Caratheodory distance on G. We 
denote by ICn the collection of all Killing vector fields on an open set Q of G. 

The idea behind the isomorphism of ICq and fC is the following. To any vector field 
in ICq we associate an element of Prol(3), the Tanaka prolongation of g with respect to 
go- By Lemma I2.29|, Prol(g) is a finite dimensional Lie algebra. One should think that 
the elements in Prol(g) are the coefficients of the Taylor expansion at a fixed point of the 
coordinates of the vector field. A vector field Z is in /Cq if and only if the coefficients of 
Z with respect to a fixed basis of left-invariant vector fields satisfy a particular system of 
PDE's, whose solutions are polynomials. Hence the coefficients of Z are polynomials. The 
same polynomials define an extension of Z for which we abuse the notation Z. Since the 
system of PDE's is in fact polynomial and linear, then the value of this operator on the 
coefficients of is a polynomial that is null on an open set. Therefore it is everywhere. 
Hence, the vector field Z is still a solution. Thus, Z ^ K,. 

Lemma 2.32. Let G he a suhRiemannian Carnot group. If is a connected open subset 
of G, then the restriction function from K = JCq to /Cq is a bijection. 

Proof. One of the fundamental point in Tanaka's work is that a locally defined infinitesimal 
generator of mappings preserving some geometric structure can be extended to the whole 
group, whenever the prolongation describing that type of mappings is finite. From Section 
6 in jTanTOj . it follows in particular that to any vector field in /Cq we can associate an 
element of Prol(g), the Tanaka prolongation of g with respect to go. So (|2.30p concludes 
the proof. □ 

Remark 2.33. Let / be an isometry between two connected open sets of a Carnot group. By 
Theorem 12.81 the map / is smooth. By Lemma l2. 32 ( the vector field f*Z, which is in ICq, 
uniquely extends to a vector field in fC. Therefore, the isometry / induces an isomorphism 
of /C. 

3. ISOMETRIES OF SUBFiNSLER HOMOGENEOUS SPACES 

This section is devoted to the proof of Theorem 11.21 and Theorem 11.11 We prove the 
theorem on global isometries immediately in Section 13.11 For the proof of Theorem II. 1^ 
we first need to consider the situation of a distance defined by a scalar product on Vi and 
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isometries defined on connected subsets (see Theorem I3.3p . Then we consider the general 
case in Section I 



3.1. Global isometries of subFinsler homogeneous spaces. We prove now Theorem 
11.21 We shall only make use of Corollary 12.121 and Lemma 12.251 of the previous discussion. 

Proof of Theorem M.SX From Corollary l2.121 it follows that / and h are smooth. We suppose 
that we have /(o) = h{o) and {dh)o\Ao = dfo\Ao- We plan to show that f = h. 

Up to replacing / with o /, we may assume that /(o) = o and that dfo is the identity 
on Aq. Let f^ be the push forward operator on vector fields. Since / is smooth and globally 
defined, the map /* is a Lie algebra isomorphism on /C, the space of Killing vector fields. We 
shall prove that f^Y^ = for all y G g. First, pick Y e V and assume by contradiction 
that /*yt / yt. Then, using Lemma [2.25| there exists Z ^ ICj, with j > and Z ^ 0, such 
that 

f,Y^ G Y^ + Z + JCj+i. 
Using again Lemma 12.251 we have 

f^Y^ = fJ.Y^ 

€ f,Y^ + f,Z + f^lCj+i 

C y t + Z + /Cj+1 + Z + Kj+i + Kj+i = Y^ + 2Z + JCj+i . 
By iteration, we get 

(3.1) f^Y^ eY^ + nZ + ICj+i, Vn € N. 
Notice that, for all A' G /C, 

f^K G {g,K I g G IsOo(M)}. 

Since IsOo(G) is compact (see Corollary I2.12p . the family {g*}g^isoo{G) is a collection of 
bounded operators. So, on the one hand, /"y^ belongs to a bounded set. On the other 
hand, any bounded set has empty intersection with the affine space Y^ + nZ + /Cj+i, for 7i 
big enough. Hence, ()3.ip is contradicted. Thus /*y^ = Y^ for every Y ^ V. Notice that 
formula (12. 3p implies that vector fields of the form Y^ as Y varies in V bracket-generate 
all vector fields Y^ with y G g. Since f^, commutes with the bracket of vector fields, we 
conclude that 

f*Y^ = Y\ 

for all y G F. This implies 

/(exp(ty) • f-\gH)) = exp{tY)gH 
for every y G g. In particular, choosing g = a and since /(o) = o, we obtain 

(3.2) f{exp{tY)H) = exp{tY)H, 

for every y G g. Let now U C G be a neighborhood of e with the property that for every 
g £ U there exists y G g such that expy = g. Then (13. 2p implies that / is the identity 
when restricted to the left cosets of U. Since M is supposed to be connected, we conclude 
that / is the identity everywhere. □ 
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3.2. Isometries of open sets in Carnot groups. In this section we prove Theorem ll.il 
in a particular case. Namely, we show that any isometry defined between two connected 
and open subsets of a Carnot group G endowed with a subRiemannian metric is affine. 

The structure of the proof of the following theorem is similar to that one of Theorem 
11.21 Since now we deal with isometries defined on subsets, we shall rely on |CC06] for the 
smoothness of such maps. Moreover, Lemma 12.321 and the observation thereafter allow us 
to extend any local Killing vector field to a global one. Consequently an isometry defined 
on an open subset of a Carnot group G will induce an isomorphism of IC. 

Theorem 3.3. Let (G, d) be a subRiemannian Carnot group. Let Qi,Q2 C G be two 
connected open sets. Let f : Qi ^ Q2 be an isometry. If f{e) = e, then f is the restriction 
to r^i of a group isomorphism of G. 

Proof. We have that / is analytic from Theorem 12. 81 Let (j) be the blow up of / at e, i.e., the 
Pansu differential at the identity, see jWarOSj . Notice that d(j)e\vi — dfe\vi- [PanSQj . the 
map (/> is a group isomorphism and, moreover, it is an isometry, being the limit of isometries. 
We plan to show that / = </>|ni- Up to replacing / with o /, we may assume that 

dfeY = Y, vyeVi. 

We now prove that = Y\ for all Y £ g. Let Y G Vi. Assume by contradiction that 

^ Y^ . By means of Lemma 12.321 and the remark thereafter, the map induces a 
Lie algebra isomorphism of the Killing vector fields JC. Therefore, proceeding as in the first 
part of the proof of Theorem II. 2| we show that 

(3.4) f^Y^ eY^ + nZ + JCj+i, Vn € N, 

for some nonzero element Z £ KLj. Let T be the group of isometries preserving a ball on 
which / is defined. Notice that, for all € /C, 

G {g,K U e X}. 

By (iii) of Corollary 12.181 the differentials g.^ depend smoothly on g £ X. Since X is 
compact, then the family {g*}g^x is a collection of bounded operators. In particular, the 
set {g^y'^ I (7 G X} is bounded. So, on the one hand, /"^^ belongs to a bounded set. On the 
other hand, any bounded set has empty intersection with the afhne space 
for n big enough. Hence, (13. 4p is contradicted. Thus f^Y'^ = y^, for every Y ^Vi . Since 
is a Lie algebra automorphism, we conclude that is the identity on right-invariant vector 
fields. But /(e) = e, so / is the identity. □ 

3.3. Generalization to nonconnected set and to subFinsler Carnot groups. We 

shall extend Theorem 13.31 to the case of subsets of G that are not necessarily connected. In 
order to do that, we use the following theorem. 



Theorem 3.5 ( |Agr09 Theorem 1]). Let M be a (analytic) subRiemannian manifold and 
set qq € M . Then there exists an open and dense subset C M such that for any q € 
there exists a unique length minimizing curve 7 connecting qo to q. Moreover, such 7 is 
analytic. 



ISOMETRIES OF CARNOT GROUPS AND SUBFINSLER HOMOGENEOUS MANIFOLDS 



15 



The following result holds for general subRiemannian manifolds. We show that an isom- 
etry is completely determined on its behavior on an open set. 

Proposition 3.6. Let M be a (analytic) subRiemannian manifold. Let f : Qi Q2 be an 
isometry among two open sets in M . Assume that f is the identity on an open subset of 
Qi. Then f is the identity. 

Proof. Let ^7 C [7]^ be the open subset such that /|n is the identity. Pick (7 € J^i. According 
to the notation in Theorem 13. 5[ consider S = Eg n ^f[q)- Fix p € S n fi. Since p S Sg, 
Theorem 13.51 implies that there exists a unique and analytic length minimizing curve 7 
such that 7(0) = p and 7(1) = q. Since Q is open, one can choose sq G (0, 1) such that 
p' := 7(so) 7^ p and 7(so) € 17. Denote by p a length minimizing curve such that p(0) = p' 
and p(l) = f{q). Let 7 be the curve formed by joining 7|[o.so] with p. We claim that 7 
minimizes the length between p and /(<?). Indeed, since f{p) = p, f{p') = p', and / is an 
isometry, we have 

d{p, f{q)) = d{p, q) = d{p, p) + d{p\ q) 
= d{p,p')+d{p',f{q)). 

So 7 realizes the distance from p to /(g). Since p € S it follows that 7 is analytic. Since 
7 and 7 coincide on an interval, they are both analytic, and have the same length, they 
coincide. In particular, q = f{q). □ 

Using the proposition above, together with Theorem 13.31 we obtain Theorem 11.11 in the 
case of subRiemannian Carnot groups. At this point. Theorem 1 1 . 1 1 will be proved once we 
extend the results to the case of a subFinsler metric. This is the content of the following 
lemma. 

Lemma 3.7. Let f be aC^ isometry among open subsets ofG with respect to a left-invariant 
subFinsler distance dsF- Then there exists a left-invariant subRiemannian distance dsR 
with same horizontal bundle as dsF such that f is an isometry with respect to dsR. 

Proof. The proof is an application of John's Ellipsoid Theorem, see | Joh48) . Let Vp be the 
horizontal bundle at p. Denote by Kp = {v G Vp | < 1}, where || ■ || is the norm 
defining dsF- John's Ellipsoid Theorem states that there exists a unique maximal ellipsoid 
Ep contained in Kp. 

Let / be any (i5i?-isometry. We claim that for any p in the domain of /, we have 
(3.8) dfp{Ep) = Ef^y 

Indeed, dfp restricts to a linear isometry between {Vp, \\ ■ ||) and (Vj(p), || • ||). In particular, 
dfp{Kp) = Kf(^p-) and dfp{Ep) is an ellipsoid contained in Kf(.py Since is the unique 

maximal ellipsoid, it follows that dfp{Ep) C Ef(^py Since df~^ also restricts to a linear 
isometry, we obtain the reverse inclusion of (j3.8p . In particular, choosing / to be a left 
translation Lp, with p G G, we have that Ep = {dLp)gEg. Therefore, {Ep}p^g, define a left- 
invariant scalar product on Vp which in turn gives a left-invariant subRiemannian distance 
on G. Moreover, the equation (13. Sp implies that any isometry with respect to dsF is 
also an isometry with respect to dsR. □ 
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Proof of Theorem \l.l[ Let {G,dsF) be a subFinsler Carnot group. Let ^1,^2 ^ G be two 
open sets and / : — ?> an isometry. Arguing as in the proof of Lemma 13.71 we apply 
John's Elhpsoid Theorem and obtain a subRiemannian distance dsR on G satisfying the 
following properties: (G, dsR) is a subRiemannian Carnot group and any isometry of G 
with respect to dsF is an isometry with respect to dsR- 

Since dsn is biLipschitz equivalent to dsF, it follows that / is biLipshitz with respect to 
dsR- By Pansu Theorem |Pan89j . the blow up exists a.e. and it is a group isomorphism, 
hence C^. Since any blow up of / is an isometry of {G,dsF), Lemma 13.71 implies that the 
blow up of / at a.e. point is an isometry of {G,dsR)- By Theorem 12.81 (ii). the map / 
is analytic. Again using Lemma 13.71 have that the map / is an isometry with respect 
to dsR- Up to composing with a translation, we may assume /(e) = e. By Theorem 
13.31 we obtain that on the connected component Q of ili containing e, the map / is a 
group isomorphism cj). Then the map o / is an isometry that is the identity on fl. By 
Proposition 13.61 we get that o / is the identity on ili, which finishes the proof. □ 

3.4. Afterthoughts. Not even in Euclidean space it is true that all group isomorphisms 
are isometrics. However, an automorphism of a subFinsler Carnot group is an isometry if 
and only if its differential preserves the first stratum (ad hence all strata) and restricted 
to the first stratum preserves the norm defining the subFinsler distance. Hence we have a 
complete description of local isometries of subFinsler Carnot groups. 

Unlikely in the Euclidean space. Theorem 11.11 cannot be generalized to arbitrary subsets. 
Here we present a counterexample. We take the subRiemannian Heisenberg group (H, dsR) 
and we define exponential coordinates {x,y,z) with respect to the basis of its Lie algebra 
given by vectors X, Y and Z. The only nonzero bracket relation is [X, Y] = Z. Consider 
the three coordinate axes, namely, 

E := exp(RX) U exp(Ry) U exp(RZ). 

Then the map {x,y,z) {x,y,—z) is an isometry of E into itself. However, this map is 
not the restriction of a group isomorphism. 

Given an isometry / of a subFinsler homogeneous space G/H, the differential of the 
blow-up at a point p equals the differential at p, when they are both restricted to Ap. 
Therefore Theorem 11.21 claims that lsOo{G/H) injects into lsOo{{G/H)o), where {G/H)o 
denotes the Gromov tangent cone of G/H at o, which is a Carnot group. However, it is not 
true that isometries of {G/H)o are always blow-ups of isometries of G/H. In fact, we can 
find counterexamples even in the domain of Riemannian Lie groups. Take for instance the 
three dimensional Heisenberg group, endowed with a Riemannian distance. We denote it by 
(H, d/j). Then its tangent cone at every point is the Euclidean 3-space, which contains all 
the rotations among its isometries. However, rotations with respect to horizontal lines are 
not isometries for (H, dR). This follows from the observation that Iso(]HI, d/j) = Iso(]H[, dsR)- 
The identification of the two isometry groups rests upon the study of length minimizing 
curves: for both metric models of M the only infinite geodesies are the 1-parameter groups 
corresponding to horizontal vectors. Since isometries must preserve infinite geodesies, it 
follows that the horizontal space is preserved by the differential of any isometry. 

We notice that the statements of Theorem 11.11 and Theorem 11.21 become equivalent if 
G/H = G and if ili = G. If this is not the case, we cannot conclude that a global isometry 
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of a subFinsler Lie group G is affine. Indeed, take the three dimensional sphere S'^ viewed 
as the space of quaternions with euchdean norm equal to one. The manifold S'^ is then a 
Riemannian Lie group. It is easy to check that the inversion map p i— )■ on S'^ is an 
isometry that is not a group isomorphism. 

For general Lie groups, isometries between open sets might not be restrictions of global 
isometrics. For example, every point in the flat cylinder M x has a neighborhood isometric 
to a disk in M^. Hence, all rotations are isometries of such a neighborhood. Of course, not 
all of them extend to global isometries. 

Last, the fact that isometries of a Carnot group G are affine maps implies that Kj = {0} 
for every j > 1. As a by-product, the Tanaka prolongation Prol(g) defined in Section [2.41 is 
© 00- Although Tanaka's method proves the finiteness of Prol(0) (see Lemma [2.290 , we 
are not aware of a direct method to show that in general Prol(g) = ® 0o- 
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